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A multi-windowing technique lor threshholding an image using local Image properties 



(54) 

(571 A "technique, specif icaly apparatus and an 
accompanying method, tor accurately thresholding an 
image based on local image properties, specifically lumi- 
nance variations, and particularly such a technique that 
uses multi-windowing tor providing enhanced immunity 
to image noise and lessened boundary artifacts. Speerf- 
icallv a localized intensity gradient. G(ij). is determined 
fa a pre-defined window (300) centered about each 
image pixelfl j). Localized minimum and maximum pixel 
intensity measures. l-min and L^,. respectively ^ are also 
determined for another, though larger, window (330) cen- 
tered about pixeKij). Also, a localized area gradient 
measure GS(ij). is determined as a sum of individual 
S ^gradients tor a matrix of pixe. positions (370) 
centered about pixel position (. j). Each image pixel(ij) is 
then classified as being an object pixel. i.e.. WacK or a 
background pixel, i.e.. white, based upon its area gradi- 
ent 6S(i j). and associated L^ and measures. 
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Description 

TECHNICAL FIELD OF THE INVENTION 

The invention relates to a technique, specifically apparatus and an accompanying method, tor accurately thresh> 
okJing an image based on local image properties, specifically luminance variations, and particularly one that uses multi- 
windowing for providing enhanced immunity to image noise and lessened boundary artifacts. 

BACKGROUND ART 

o 

With digital image processing and digital communication becoming increasingly prevalent today, increasing amounts 
of printed or other textual documents are being scanned for subsequent computerized processing of one form or another 
and/or digital transmission. This processing may involve, for example, optical character recognition, for converting printed 
characters, whether machine printed or handwritten, from scanned bit-mapped form into an appropriate character set, 
5 such as ASCII, the latter being more suitable for use with word processing and similar computerized document-process- 
ing tasks. 

Scanning a gray-scale document typically yields a multi-bit. typically eight-bit, value for each pixel in the scanned 
document. The value represents the luminance, in terms of a 256-level gray scale, of a pixel at a corresponding point 
in the document. These pixels are generated, depending upon the resolution of the scanner/frequently at resolutions 
o of 200-400 pixels/inch (approximately 80-1 60 pixels/cm), though with highly detailed images at upwards of 1 200 or more 
pixels/inch (approximately 470 pixels/cm). Consequently, a scanned 8 1/2 by 11 inch (approximately 22 by 28 cm) image 
will contain a considerable amount of gray-scale data. Inasmuch scanned text generally presents a written or printed 
characters of some sort against a contrasting colored background, typically white or black print against a white or light 
colored background, or vice versa, the exact luminance value at any one pixel in the text is not as important as whether 
5 that pixel is either part of a character or the background. Therefore, scanned textual images, or scanned textual portions 
of larger images containing both text and graphics, can be efficiently represented by single-bit pixels in which each pixel 
in a scanned image is simply set to. e.g.. a "one" if that pixel in the original image is part of a character or part of 
foreground information, or to. e.g., a "zero" rf that pixel in the original image is part of the image background. To easily 
distinguish the different types of scanned images, a gray-level image is defined as one having multi-bit (hence mutti- 
0 value) pixels, whereas a binary (or bi-level) image is formed of single-bit pixels. Furthermore, since binary images gen- 
erate considerably less data for a given textual image, such as, e.g., one-eighth, as much as for an eight-bit gray-scale' 
rendering of the same image, binary images are more efficient over conesponding gray-scale images and thus preferred 
for storage and communication of textual images. Binary images are also preferred because of their easy compressibility 
using standard compression techniques, e.g., CCITT Groups 3 or 4 .compression standards. - 
? Gray-scale images are converted to binary images through a so-called thresholding process. In essence, each murti- 
bit pixel value in a gray-scale scanned image is compared to a pre-defined threshold value, which may be fixed, variable 
or even adaptively variable, to yield a single corresponding output bit. rf the multi-bit pixel value equals or exceeds the 
threshold value for that particular pixel, the resultant single-bit output pixel is set to a "one"; otherwise if the threshold is 
greater than the multi-bit pixel, then the resultant single-bit output pixel remains at "zero". In this manner, thresholding 
extracts those pixels, such as those which form characters, or other desired objects, from the background' in a scanned 
gray-scale image, with the pixels that form each character, or object, being one value, typically that for black, and the 
pixels tor the background all being another value, typically that for white. For ease of reference, we will hereinafter 
collectively refer to each character or other desired object in the image as simply an "object". 

Ideally, the best thresholding process is one which accurately selects all the object pixels, but nothing more, in the 
scanned image and maps those pixels to a common single-bit value, such as, e.g., "one" for black. In practice,' noise, 
background shading, lighting non-uniformities in a scanning process and other such phenomena, preclude the use of a 
single fixed threshold for an entire image. In that regard, if the threshold is too low. the resulting image may contain an 
excessive amount of noise in certain, rf not all regions; or, if too high, insufficient image detail, again in certain, H not aD 
regions - thereby complicating the subsequent processing of this image: Given this, the art recognizes that a preferred 
approach would be to select a different threshold value that is appropriate to each and every pixel in the scanned image 
In doing so. the proper threshold value is determined based upon local properties of the image, i.e.. certain image 
characteristics that occur in a localized image region for that pixel. Hence, the threshold would vary across the image, 
possibly even adapt to changing localized image conditions. 

In general, a common methodology for variable thresholding relies on measuring localized image characteristics 
such as local intensity contrast (or gradient), local averaged intensity and/or local variance, in a local window centered 
about a pixel of interest and then using these measures to classify image pixels into either object pixels, black, or back- 
ground pixels, white. Here, too, reality diverges from the ideal inasmuch this methodology is complicated, and often 
frustrated, by a need to extract various objects in a wide range of documents but with minimal user intervention, such 
as for purposes of initialization and object identification, and while still yielding a clean background in the thresholded 
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jj. thccp obiects may include. e.g.. dim. broken objects; and objects that presents relatively to* contrast, 
image. In reality. hese fj^^™™. ^ ' etrtoeMe6 in a black background, 

such as white objects .n a gray background, ano gray j performance with actual 

Nevertheless, given ^ e ^^^ 
images, the art has persisted by ^^^'^^^^^^^^^ in practice, tend tolimittheir utility, 
performance. However, all these approaches sutler ton °" e J" are taught in M. Kamel et 

P Vartous approaches ^ 

al.. "Extraction ol B.na y Cte 'f ^ h £ ^oes 203-217 Here, a logical level" approach is based on comparing a 
*>'; ^^"^1%^™^ s noisy) with tour local averages in neigltoorhocKte 
orav level ol a given pixel or its smoothed gray ievenn me » " . . d th dven pixe | IS suff iciently below 

a,, tour .oca. averages, then the gjven pixel ^J^SJ* a character/graphics image. Rrst. most ol 
on considering every p.xel ^JJJ" 6 ^ ,'ter 7e litter ostensibly luncttoning to remove "particle- noise. The 
the background pixels are detected using a logical wter vm ' ^ h each given p i Xe i with slopes 

SUa^edt^ whi* are t-a* and 

ol o. n/4. n/2 and 3«/4. The '«"»'"B ™er«J orna y » ^ additional back- 
background pixels which are white potsible character/graphics pixel, the gray level 

ground pixels using a predetermmed stroke Lastly, a gray-scale character/graph- 

of its background image is ^T^J^^^ original scanned image wHh resulting 

ics image fe obtained by image. Though the global threshold 
*, difierences then being .l***^^ 

value itself is fixed, basing the result on a ditto ence ^^nin appear to be somewhat immune 

•^rct^eV^^ 

exSng dim and/a broken ^^'^^^'pS 4 868.670 (issued to R.R.A. Morton et al on September 
Another approach, as described ,nUn ^ r ^l^™ *2° nfl a^cKground value in an image. wHh 8 threshold 

19. 1989 and ownedby the ^^^^ h ^^^TZ ^L<^ signaL Here, whenever a transition 
value being a sum of a tracked tec^ 

occurs in the image, such as an edge, the feedback agnal « ^^^ a value has a reduced noise content, 
m^ify the threshold ^^J^^^^^^Z^V^en^ transitions due to abrupt changes 

ties in detecting low contrast objects. A& stoffe , ^ a , 28, ! g^). 

A further approach is described in ^^^^^^et potential. wNch is obtained on a pixel-by-pixel 
Here, adaptive thresholding fSSS- This offset potential is used* conjunction 
basis as a function of whrte peak ano . th ^ varies p -„el-by-pixel. The peak and valley poten- 

wHh nearest neighbor ^ge Potentiate! that pSl with predetermined minimum 

extracting low contrast ^J^SSrTSSS specHically apparatus and an accompanying method, tor accu- 
P^^iinrnnHEJMBIHOM 

^^^.or^r-i^c in the art through our inventive rnuHi-windovv 
We have substantially and advantageously overcome the deficiencies .n the an tn ug 

thresholding technique. . .. in1enEitv arad ient G(i j). is determinedtor each pixelfij) in an incoming 

SpecHically. through our invention. ^£22T£2SS 2 a wind ow. illustratively 3-by-3. of pixels centered 
scanned grayscale bit-mapped .mage. This levels are detected tor an N-by-N pixel window 

about pixelf, j). Next, minimum intensity. ^^T^^^^ GS f,j) being a sum of individual intensity 
centered over the image about P^.***^ centered about position (i j). 

gradients, is ascertained for back ground pixel, i.e.. white, primarily based 

lach pixelOJ) is Mr -class ted £ ^^J^^^JK,!'^ ,1, values. These three parameters are 
upon its area gradient. GS(ij). ana seconoamy upon » -m . i n various windows, one tor determining 
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Using these local measures, each image pi*el(i j) is first classified as being near an edge or not. In that regard, each 
pixel near an edge is so classified if the local measures therefor, specifically its associated area gradient, exceeds a 
pre-defined threshold value. Otherwise, that pixel is viewed as falling within a locally flat field, i.e., of relatively constant 
gray-scale. Specifically, edge pixels are classified by comparing their intensity values against average intensity values 
tor local N-by-N pixel windows therefor; in contrast, pixels in flat fields are classified by comparing their intensity against 
a pre-determined intensity value. 

In particular, an image pixel(i j) located in a vicinity of an edge in the image is detected whenever the area gradient, 
GS(ij). for that pixel is high, particularly being larger than a predefined gradient threshold. GT. Once such a pixel is 
found, each pixel on a darker side of the edge is found. This latter pixel being in the center of a local N-by-N, e.g., 7-by- 
? 7, pixel window is classified as an object pixel, i.e., black, whenever its intensity, Lc, is smaller than an average of hs 
associated and values. Alternatively, if the intensity of this latter pixel, Lc, exceeds the average intensity value 
of and L^,, then this particular pixel is classified as being background. Le.. white. 

Where the area gradient, GS(i j), for pixel(i j) is less than the gradient threshold, such as where the N-by-N window 
slides along an image region of relatively constant gray-scale, pixel(ij) is classified by simple thresholding, i.e., thresh- 
5 olding its gray-scale value against a constant predefined threshold value, IT. Here, if the gray-scale value of pixel(i j) is 
less than the threshold value IT, this pixel is classified as an object pixel, i.e., black; otherwise, this pixel is designated 
as part of the background, i.e.. white. 

To enhance image edges and by doing so further increase thresholding accuracy, the intensity values of those pixels 
near an edge are modified. For the preferred embodiment, black pixels are illustratively represented by a value of zero 
o and white pixels by a value of Specifically, for those pixels located on a darker side of an edge and having an intensity 
value that exceeds the threshold value. IT, the intensity of each of these pixels is reduced to a value slightly below 
threshold IT, e.g.. to a value IT-. In contrast, the intensity values for those pixels, located on a brighter side of an edge 
and having an intensity value less than threshold value IT, are increased to an intensity value slightly greater than thresh- 
old value IT, e.g.. to value IT*. A high quality binary image can then be produced by merely thresholding the resulting 
5 gray-scale image against pre-defined threshold value IT. 

Advantageously, through the use of area (summed intensity) gradients, the present invention significantly reduces 
both background noise and boundary artifact generation while accurately extracting objects in a thresholded image. The 
modified gray-scale image, when subsequently thresholded using a fixed threshold value IT. greatly enhances detection 
of low contrast objects and thus readily produces a high quality binary image. 

v 

BRIEF DESCR IPTION! OF THE DRAWINGS 

The teachings of the present invention may be readily understood by considering the following detailed description 
in conjunction with the accompanying drawings, in which: 

FIG. 1 depicts a high-level block diagram of document imaging system 5 that embodies the teachings of our present 
invention; 

FIG. 2 depicts the correct alignment of the drawing sheets for FIGs. 2A and 2B; 

FIGs. 2A and 2B collectively depict a high-level flowchart of our inventive multi-windowing thresholding method; 

FIG. 3A depicts a 3-by-3 matrix of pixel location definitions which we use in determining, through a "Sober gradient 
operator, gradient strength for current pixelfij*); 

FIG. 3B depicts a graphical representation of an N-by-N neighborhood of pixels centered about a current pixel(i j) 
in an image intensity record; 

FIG. 3C depicts a graphical representation of an (N-2)-by-(N-2) neighborhood of pixels centered about pixel position 
•o in an image intensity gradient record; 

FIG. 4 graphically depicts intensity profile 400 of an illustrative scan line of an original gray-scale image, such as 
that illustratively on document 10 shown in FIG. 1 ; 

$ FIG. 5 graphically depicts a modified intensity profile which results after thresholding intensity profile 400 shown in 
FIG. 4 according to the teachings of our present invention; 

FIG. 6 depicts a block diagram of a preferred embodiment of our present invention; 
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FIG 7 depicts a block diagram ol Sum of Gradients Circuit 620 which lorms part of circuit 600 shown in FIG. 6; and 

FIG 8 depicts a block diagram of 7-by-7 Maximum and Minimum Detector 635 which also forms part of circuit 600 
shown in FK3. 6. 

To facilitate understanding, identical reference numerals have been used, where possible, to denote identical ele- 
ments that are common to various figures. 

MQDES OF CARPV^ OUT THE INVENTION 

AtiPr readino the following description, those skilled in the art will quickly realize that our invention is applicable tor 
.,<;* £ nearly any document imaging system tor accurately thresholding scanned documentary images ccrta.ningl.ne 
fn both rebaSess of what that fine art contains and the media upon which the image origmaJly appears. For example. 
The* .Se art SS be grap hs. maps, characters and/or line (skeletal) drawings. Nevertheless tor thepurposeol s.mplrty.ng 
ne olf^ we will discuss our invention in the context of use in thresholding scanned character data, such 

« t,>*iual letters and numbers, which we will collectively refer to hereinafter as •objects-. . 

^ouSoses of illustration and discussion, we define black and white gray-scale pixels as having eight-brt gray- 
. J^?and -2S5-. respectively. For consistency, we also define output binary pixels wrth black berng V and 
S ^!^no"r C.ea^y ot.invemivemlodwil.^ 

InequaS that compare pixel intensities, as would be readily apparent to those skilled in the art. reversed from those 

^^d^cl^gh-level block diagram of document imaging system 5 that embodies the teachings of our present 
• JL on >?s»Swn system 6 is formed of gray-scale scanner 20. digital image processor 30 and "simple" threshing 
SSTS" to^e^on document 10 containing various objects of interest is scanned by scanner 20 to produce mutb- 
b^voSf! efch brbit-mapped grayscale image data. L This data is routed, via leads 25. to a data input of digrtal 
SI^SLsSr which, in turn and to the extent relevant here, thresholds the scanned -mage data and generates both 
rSSSSJ^I* on ,eads 37 and an binary imaoe ° n ,eadS 33 - ™« mt ? W,Bd gray^calermage. as 
S^toed iSSeaS detail below, has its edges enhanced by processor 30 to subsequent ^ncrease threshoW.ng accu- 

^T^SrfiS "way-scale image data appearing on leads 37 is routed to an input of thresholding arcurt 40 which— 
TSJS^S ^iSSKSi Pi-I in JmodHied image data against a pre-deftoed^ed ttreshok, value thereby 
nSrsoSle^simple- thresholding. The resufling thresholded. i.e.. binary, image produced by arcurt 40 rs applied. 
J2 ^as ano^output binary image. Digital image processor 30 performs thresholding ,n accordance wrth our 
^^^"TirKtehigh data throughputs required tor processing bit-mapped images processor 30 * prefer- 
SSSSSS^ "dedicated hardware circuitry, including our inventive circuit 600 shown .n FIG. 6 and discussed m 
nSi f£S Alte^attely. this processor can be implemented through one or more general purpose m.aoprocessors. 
2f i^Sted memory and supporting circuitry and suitably programmed to implement our present .nyenton .n soft- 
wTe!^S ZZe So^Sessa(s) could execute instructions sufficiently fast to produce the requisite data 

throughput. our inventive ^windowing thresholding method 200 is collectively depicted in FIGs. 2A 

and tor wnfch ^correct alignment ol the drawing sheets tor these figures to shown in FIG. 2. Dunng the course of 
discussinq method 200. reference will also be made to FIGs. 3A-3C where appropriate. • . 

M^Sd 200 performed for each and every gray-scale pixel in an incoming image, thereby rteratng though the 
inJI Snce manner through which each gray-scale image pixel is processed is identical across all such pixels, we 
wJ? merdv o^cussThis routine in the context of processing generalized pixel{ij). where i and , are posrtive integers and 
^in?D,xeSontal and vertical indices within the incoming grayscale image. In additton * gray-scale image data. 
11Z sSS vXes of two input parameters, specifically fixed thresholds IT and GT These thresholds are adjusted. 
L^icrtoed beSw either to provide satisfactory thresholding across a multitude c. diHenng images with varying char- 
tuch « contrast and illumination, or can be adjusted to provide optimum threshokJing for any one type of 
f^o^o banning condition. In any event as a result of performing method 200 on all such gray-scale '™9epoce«s. 
Xsho^eoSy o' modHied grayscale image will be generated, wrth each pixel in the resulting image c^respond-ng 
r!^P in^mino imaoe Although not shown in FIGs. 2A and 2B. H a modHied gray-scale image is to be produced. 
ESS?? 333din. -simple- fashion using a fixed, predefined threshold, having a value IT. as that value 

X S X ima0e <*" the " be <Urthef P,OCe£Sed - e ,hrOUSh SCaHn ° W * " 



^Irfoarticular upon starting method 200. step 203 is first performed. This step determines a gradient str engthfor 
• .^r^fe fe accomplished by use of the so-called -Sober gradient operator on a window of pixels centered about 

in^ua^ore (1 )-(3) below, the Sobel operator relies on computing horizontal and vertical pixel mtensrty gradients. 
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GX(i j) and GY(i.j), respectively, and for each pixel position (ij) forming the gradient strength, G(i,j) as an absolute sum 
o1GX(ij)and GY(ij): 

GX(ij) = L(i*1jO) + 2L^ (1) 
GY(ij) = L(M j+1) + 2L(ij+1) + L(i+1.j+1) - L(i«1 j-1) - 2L(i,j-1) - Lfi+1 j-1) (2) 
G(ij)-|GX(ij)|4|GY(i,fl| (3) 

1 where: G(i,j) is the gradient strength at pixel position 
. (i j); and 

L(i j) is the image intensity, luminance, at pixel 
position (ij). 

The resulting gradient strength value for every image pixel collectively forms a gradient strength record for the entire 
scanned image. ■ 

Once the gradient strength, G(i,j), is determined for pxelflj). method 200 advances to step 206. This step when 
performed, determines the area gradient for pixel position (i j), i.e., GS(ij), as the sum of the gradient strengths tor each 
and every pixel position within an (N-2)-by-(N-2) window centered about pixel position (ij). This window is illustratively 
5-by-5 pixels in size and is shown, as window 370, in FIG. 3C for an N-by-N, illustratively 7-by-7, window shown in FIG 
i 3B, the latter being window 330. centered about pixel(ij). For purposes of comparison, the periphery of ah N-by-N 
window is shown as window 350 in FIG. 3C. Though shown sequentially to simplify illustration, step 245 is generally 
performed at essentially the same time, as symbolized by dashed line 244. as is steps 203 and 206. Step 244 determines 
both minimum and maximum pixel intensity values. and L^,. respectively, in an N-by-N window centered about 
pbceKU). 

Once the area gradient is determined tor pixel position (ij), then, through the remainder of method 200, the three 
image measures. GS0.j) and L™, and L^,. associated with this particular pixel position are used to classify pixeffij) 
as an object pixel, i.e.. black, or a background pixel, i.e.. white. 

In particular, decision step 208 is performed to assess whether the value of the area gradient for pixel(i j) i e GSfi j) 
exceeds a pre-defined threshold value. GT, or not. This test determines whether pixel(ij) lies in a vicinity of anedge in 
? the scanned image, or not. If the area gradient is less than the threshold value. GT, then pixel(i j) does not lie near an 
edge. Hence, pixel(i.j) lies within a localized relatively constant lone, i.e., liar field, region of the scam ted ymy-suile 
image. In this case, method 200 advances along NO path 21 1 emanating from decision block 208 to decision block 215 
This latter decision block determines whether the gray-scale intensity of pixel(ij), i.e.. 1^. exceeds another pre-defined 
threshold value. IT. If this gray-scale value is less than the threshold, the pixel is classified as an object pxel i e here 
' b,ack ; otherwise, the pixel is classified as a background pixel, i.e., here white. Specifically, on the one hand if pixel 
intensity. Lc is less than or equal to threshold IT, decision block 215 advances method 200. along NO path217 to 
decision block 222. This latter decision block determines whether a user has previously instructed the method to produce 
a binary or gray-scale output pixel. If a binary pixel is desired, then decision block 222 advances the method via YES 
path 225, to block 228 which, in turn, sets an intensity of output pixel(ij) to black, i.e.. zero. Ahernativery. H a gray-scale 
output is desired, then decision block 222 advances method 200, via NO path 224. to block 230. This latter block, when 
performed, sets the intensity of output pixel(i.j) to the intensity of without any modifications made thereto If on the 
other hand, pixel intensity. 1^. exceeds threshold IT, decision block 215 advances method 200, along YES path 218 to 
decision block 232. This latter decision block determines whether a user has previously instructed the method to produce 
a binary or gray-scale output pixel. If a binary pixel is desired, then decision block 232 advances the method via YES 
path 235. to block 237 which, in turn, sets an intensity of output pixel(i.j) to white, i.e.. one. Alternatively, H a gray-scale 
output is desired, then decision block 232 advances method 200, via NO path 234, to block 241 . This latter block, when 
performed, sets the intensity of output pixel(i j) to the intensity of L^. without any modifications made thereto Once step 
228. 237 or 241 is performed, method 200 is completed tor pixel(lj); the method is then repeated for the next image 
pixel in succession, and so forth. 

Alternatively, if area gradient. GS(ij) exceeds the threshold value. GT. then pixel(i.j) lies in the vicinity of an edge 
In this case, step 245 is now performed to ascertain the values of and L^, if these values have not already been 
deter mined, as set forth above. Thereafter, method 200 advances to block 248 which calculates an average pixel intensity 
value. Uvg, occurring within the N-by-N pixel window centered about pixel position (i.j). This average intensity value is 
simply determined by averaging the values L^, and L^. 

Once this average value has been ascertained, method 200 advances to decision block 251 which compares the 
intensity of pixelfi j). i.e.. 1^, against its associated average intensity value, L^. When this pixel is situated on a darker 
side of an edge and hence an ot^ect pixel, then its associated average intensity value will be greater than or equal to 
its intensity value. I*. In this case, the output binary pixel for pixel position (i j) will be set to blade Otherwise if pixelfi j) 
is situated near an edge but its average intensity value. L avg . would be less than its intensity value. L^. then mis pixel is 
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L then decision blocK 251 advances method 200. along NO path tooec* -^c, output pixel. It a 

Amines whether a user ™^ P '^ES olock 268^ich. in turn, 

binary pixel is desired, then dec* on I ^ "> ?a gray-scale output is desired, then decision btock 260 
sets an intensity of output f^^^f^»^ 4 ^Zm blcWwhen pertormed. determines whether 
advances ^^Eg^^SSSt*. intensity ol P ixe,(i j) is less than or equal to mresho* 
pixel intensrty. U. exceeds me pre oe ■ executed, sets the gray-scale output tor 

IT. then method 200 advances, along ^^'l^^T^ce^ the value ol threshold IT, then method 

value 8 that is sightly less. I.e IT-. ^J^^JLed* its associated average intensity value. U*. thendecfeton block 
Alternatively. H W^^^^^XSJ This latter decision blcx* determines whether 
251 advances method 200. along , YES path 2 a» d «^^2. output pixel. H a binary pixel is desired, 
a user has previously instructed iStSSSSt^. fatum. sets an JttensHy o. output 

the n decisis b*K* 2B0 then decision block 280 advances method 200. 
pixeKij) to whrte. ..e ^^'iT TWs fa^btoc+Jwhen pertormed. determines whether pixel intensrty. L*. •e lees 
via NO path 284. to decision Ucx* 290. This .latter .^™ p _ fe ual to threshold IT. then method 200 

than pre-defined SS!S^^"Sf^ output ** I--M »<> ■** 

advances, along NO pa* 292. to block 295 which • q me n method 200 advances; along YES path 

intensity value I,. Now I * ^SSSSSpU J) to a valuethat is slightly larger. Le, IT*. 

* 294.toblock297. whrch. «™*ZZ^££ ^n^Sa is less than, respective!* threshold IT fe not critical 
^^^^^^^ ^ 285^ 297 has been pertormed lor pixelOi): method 200 fe 

fhen'repeated tor the next image pixel in s " M ^^ h ^ r *°* ca||y depicls int ensrty profile 400 of an itlustrafve scan 
V^tHsunderslandi^ 

so line of an original gray-scale image ^euch astha J™^™^ 600> shown in FIG. 5. results. As te readily apparent 
profile 400 through our .rrventive method modri.ec ' J^rt 5Se mage pixels located near an edge are modified, 
from comparing profiles 400 and * £ge and while rts intensity is larger than threshold 

in this regard, when such a p.xe . -located \m a ^^^^cJSy test than threshold IT. AHernatively. when an image 
value IT. the intensity of this p.xel rs * f - 1 te tesSln threshold IT. the intensity of this pixel fe 

" S^ofva" u%^ T* ' ^ "^'^ reSU,ttne 

Sed gray-scale image ' •^^^Jl^^^,^, specifically circuit 600. ol our present invention. 
FIG. 6 depicts a block digram of a Pur red ^^f*^'™^ P ^ / Cleany> -^ge processor 30 would 

L»9ing "'»» M0: ™^"r^^ 2 »?SS^f£ 2A.nd 2 B and dttauas* h detail pbo*. 

« 675. (SO* 600 coMMfr ^"^"fi"? "otaS in pa.altal. via laads 60S and 606. lo an inpo. ol 
iaopataSon. eighl-M "W< 8™^' e ' ra ^^Jf raSDeteya 610. apacHicaly sertaa-connactad aingla 
„na dataya 6,0 and ta - W J^d-j^D-jr £ ^ ■ « M . 

line delay elements 610l 610 2 ana eiu* P ow,e * oarh three ^ ixe | line of the window. The outputs of all three 
Each delay element is tapped at three ^^J^^^S^Z^^^ Nation of the Sobe. 

„ delay elements ttZ5Z%Z£££ tor PixelOJ). i.e.. GO j). on output leads 617. This 

operator, as described above provides an ~^ circuit 620 which in turn, sums all the gradient intensity values 
gradient value is applied to an ,nput to nT^Ta^sST^ari sum. as an area gradient value, i.e.. 

I a 5-by-5 ^«-2te S cZl SS^^S^SL^ in detail below. This area gradient value 
6SC..D. on ^^^Si^^SS^^ this value against predef ined gradient threshold. GT: 

55 is applied to an input ( J \\^^^^^^Z^fa\or. The resulting comparison output, appearing on 
the latter being applied to another inpiit ( B )to th« i same compa comparison output is applied as an 

KYJZSSSl as discussed in detail below, the appropriate 

5££KpU i-e.. Lc or one of the predefined values IT- or IT* 
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Max and MM detector 635. depicted in FIG. 8 and discussed in detail below, ascertains the maximum and minimum 
p.xel intensity values, i.e and L^,. of those pixels contained within a 7-by-7 window centered about pxelfiT 

Resulting L^, and appearing on leads 637 and 639. are then averaged by averaging circuit 640 TOs S 

contains summer 642 whrch merely adds these two va.ues together into a resuHant sum. and* anJdetey drclTSS 
wh.ch implements a d,v,del by operation by shifting the sum one-bit to the right; hence dropping the M MkM 
M. The resultant averaged , ntensrty value is then appropriately delayed within circuit 646 toTpurposes of acnie^o 
proper synchronfcation wrthin circuit 600. ^ acnieving 

Ifme area gradient velue ^S(1j) exceeds me predefined gradient threstold. GT. then me average 
L used as a threshold level .n determining the value of output center pixelfi j); else. H the area gradient value feless' 
3 than or equal to the grad,ent threshold, then value IT is used as the threshold level in determining the c5 ouS 
center p,xe .(■ j). In th* regard Jhe averaged intensity value. L^. is applied to one input of comparator eSTSiSS 
center pixel value. L^, .5 applied through delay element 630 to another input of comparator 650as wertasto^e^rt 
of comparator 655 The delay* element 630 is set to assure that the proper corroding values tfLa^T "£? 
synchronously appl.ed to collect,vely comparators 650 and 655. multiplexors 680 and 690. and gating drc!* 6M "m! 
s ixed threshold va.ue. IT. is applied to another input of comparator 655. Comparator 650 p^ucesTl^XTor^ 
level output on lead 653 rf p.xel mtens,ty va.ue Lg is less than, or equal to o, greater than, respectively 5 assocIaS 
averaged .ntensrty value. L, vs . Th.s oulput level is applied to both one input m of multiplexor 680 a* jWSS 
AND gate 662. Mu.tip.exor 680 selects the otrtput binary pixel as betweeTtwo bits generated fromusi™ Z dXLS 
thresholds. i-.-luerror L In that regard, comparator 655 produces a high out^t level at its™£C^ne££ 
o the predehned threshold value IT is greater than pixel intensity value L*. The level at output A>B is routed 

657. to another input ("0^ of multiplexor 680 and to one input of AND^ale 670. Muttp^elo p^oduc^^ mToS 
binary value for P ,xel(i.j). To do so. the comparison output level produced by comparator 625 indici tive^ Xth^ 
area gradient GSO^ceads the gradient threshoW. GT. is applied as a s'e.ecTsigna? vfa ^^^^62^ a ^ 
.nput of mult^lexor 680. If th.s select signal is high, thereby indicating that the area gradient exceeds the oVadLrtSS 
5 o«. then multiplexor 680 routes the level applied to its 1- input, i.e. thai generated by compa^toT eso to btaTv ciSl 
lead 33: else, the multiplexor routes the level then appearing at its "0" input to lead ^ C ° mpara,0r 6501 to b,narv 

Multiplexor 690 routes thecenier pixel value, l^. or a pre-defined value IT + or IT- as the oulput gray-scale value to 
e.ght*rtoutou. leads 37. Pre-def.nedva.ues IT + and IT- along with center pixel value 1, are SS^SSSZ 
spondmge.gh^b.t.nputstomurt.p.exor690.^ 
o SO and 81: 4 these signals assume the binary va.ues rero, Tor V. then the mu.tip.exor will route eSZmSKS 
Lc. value IT+ or value IT-, respectively, to oulput leads 37. Gating circuit 660. in response to the ccmoa iS , oZ£ 
signate produced by comparators 625. 650 and 655 generates, by simple comWnaloria^ogic. th SSeXTS- 
and Si, applied to murtip.exor 690. Specif icaHy. « the area gradient is not larger man ta^Jl^SSTS 2 
d.scussed above, gray-scale pxel value without any modification, will be applied through multiplexor 69C TtooSr^ 
5 eads 37. Alternative^ H the area gradient exceeds me gradient threshold, me^ multiplexor £oS K5ft^2S 
IT+ or IT- as a mocfif ied gray-scale output value to lead 37 based upon whether center pixel intensr^al^ U iJTesI 
than ite correspond.ng average p.xel .ntensrty value. L^. or not. Since the operation of gating circuit Zo Severn 
from the above descr.pt.on to anyone sMled in the art. it will not be discussed in any further detail. V^?Sn£ 
are merely held in appropriate registers (nol shown) and from there applied to corresponding inputs of muTtb exoTego 
' de P icts a block d,a 9 ram °» <* Gradients Circuit 620 which lorms part of circurt 6W "s£w? n RG^' 

Circuit 620. as shown in FIG. 7. is formed of adder 710 and line delays 720. the latter contain* 2£E£J2S2i 
sing.e-.ine delay e.ements 720 0 . 720,. 720 2 and 720 3 . Incoming gradient intensity values are ap^i TJfEES 
from gradient detection circurl 615 (shown in FIG. 6). to one input of adder 710. shown in FIG. 7. tmS£i tne oli^I 
of each of the four fine de.ays 720 is routed over a different one of four feedback .eads 715 to a 'd5S5!22E 
input of this adder. As a result adder 710 forms partial sums of l-by-5 gradient va.ues which »?S£TE?2 
detay element 720 0 . To generate a S-by-5 sum of the intensity gradients, hence producing an area gradient measure 
four preceding conespond.ng 1-by-5 sums are added together within adder 710 to a present 1-by-5sum witiTthe^eS 
an overall 5-by-5sumbe.ngapp..ed to °u>P«, , ea d 622. Use of mese de^ 

tially reduces the amount of logic that would otherwise be needed to generate twenty-five intermediate sunS 

FK3. 8 deplete a block diagram of 7-by-7 Maximum and Minimum Detector 635 which also forms part of circuit 600 
shown m FIG. 6. As noted above detector 635 determines the maximum and minimum pixel intensity values T an^ 
^respectively . wrthm ,i 7-by-7 window centered about pixel position(i.j). This detector is formed of two separate 
courts: max.mumdetecting c.rcurt 805 and minimum delecting circuit 840 which extract a pixel value havinoVrnSm 
and mmimum inlensrty value. 'espect.vely of all the pixels contained within the 7-by-7 window centered arour^SS 
T? '^oTl *, ^ ? two values to leads 637 and 639. Circuit 805 contains maximum detector Sl^and I line 
delays 820. the latter be.ng formed of s« series-connected single-line delay elements 820 0 . 820, 820^ 820, 8»«3 
820 5 . Similarly, circurl 840 contains minimum detector 850 and line delays 860. the latter being formed of rixSS? 
connected single-line delay elements 860 0 . 860,. 860 2 . 860 3 . 860 4 and 860 s . Inasmuch as circute 805 and sH 
isandent^almannerwrth the except,onlhatdeteclor810locales maximum values whiledeteclor 850 locates7n?n"mum 



8 



EP 0 712 094 A2 



70 



15 



SO 



25 



30 



35 



40 



v»k«c both from the same series of pixel intensity values applied over lead 608. we will only discuss arcurt 805 m detail; 
^LV JS* n *• art will then readily appreciate how circuit 840 functions from this d.scuss.on. 

o xeHntensity va.ues are applied, over lead 608 to one input ot maximum detector 810. In addition, the 
J^I^Tme s!x Hne delays 820 is routed over a different one of six feedback leads to a respectwe .nput ol th* 
SSiuen^maximum detector 810 extracts the maximumpixe. intensity value from , a 1*y-7 senes ol pocel 
SS^ri^SirS maximum value as input to line delay element 820 s . In conjunct.or. wrth six preceding cone- 
J nSmum pixel values stored in line delays 820. maximum detector 810 locates the max.mum p,xel mtensrty 
SP °?£?tn r?53 Saw centered about pixel(ij) and applies that value, as output, to leads 637. Here, the use erf 
^Z^n^^^enisB20 860 substantially reducesthe amount of. ogic.that would otherwise be needed 
4« ^oneraie inier mediate maximum and minimum pixel intensity values. , 

9 A?on! ~n now Appreciate, the quality of the resulting thresholded image produced by our .mention .s controlled 
hv th^.uesTet?n^d Xeshofds GT andV Threshold GT is set to properly classify image pbcete located in the vcnrty 
S^S nanin^oe Relatively towGTv 
f o ixels Sid in image regions of unfform tone. I.e.. "flat" fields. In that regard, a tow IT value tends 0 classify 

's^uni^ 

P ^ ~nor« SmS to -single- thresholding with a fixed threshold IT. In this situation, the value of threshold GT 
PU Sfvs^Cer "a" the a,eT gradient, thereby causing our invention to classify pixels by essentially solely com- 
■^Tr^ZV^e\ of interest against fixed threshold IT. Our invention can also produce an outhne image tivough 
sttttog the^lue of threshold IT to zero, in which case all the image pixels will b « ^assified as white except for the edge 

• .^wlhlrriheir associated area gradients are larger than the gradient threshold. GT. 
P ' AH^h one Seared embodLnt of the present invention has been shown and described tai deta I here* . many 
othe^S e^llnts that incorporate the teachings of the invention may be easOy constructed by those sk-lled m 

the art 

.k.^ ■c-r p.A. APPLICAPH IT Y ANP ADVANTAGES 

The oresent invention is useful in image scanning systems and particularly tor threshing scanned Oray-sc^e 
imao « co^atnTnLTne art The invention advantageously provtoes more accurate threshing than tr«t prj.ousty 
^SZSnH Ihe art by exhibiting enhanced immunity to background noise in the scanned .mage and substarrtmly 
eliminating boundary artifacts from a thresholded image. 
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Claims 
1. 



2. 



a o^ihod for thresholding an input gray-scale image into a first output image, wherein said input . image is formed 
^Sxeteeacfhalga 

fe toS pfelVea* Ling a Spending output pixel value associated therewrth. charactered .n that the 

^as^S' in -Xnte to a plurality ot pixel values in the input image, an area gradient value for a f irst 
window! olefin*, sire, of intensity gradient va.ues associated with ones of the p.xel values centered 
=k«. ri a Lrreni Dixel poshion. (i j) (where, and j are pixel indices), in the input image; 

8 de? S^ wil a second window (330). of pre-defined size, of input pfcels cemered a^ the 
cunem plxel p^Sfon (l^the input image, a maximum pixel value and a mtoimum pocel value of the P .xel values 

S^^rC^^S«« — and the maximum and minimum pixel values, a cunentoneof 
£ current pixel position (ij) in the input image into an output p.xel value at a corresponding 

position in the first output image. 

th* method of claim 1 wherein the area gradient ascertaining step comprises the steps of: 

measuring in response to a third window (370). of the pixel va.ues. of a pre-defined size and centered about 
the curTrt X^sition (i.0 in the input image, an intensity gradient. G(i j). va.ue for the cunent pixel posrtion such 
!teUa a s^ceSn of input pixels in the input image, a plurality of corresponding mtensty grad.ent va.ues * 

^'"lofrnfng the first window of intensity gradient values from the plurality of intensity gradient values and. in 
response to said first window, determining said area gradient value 

The method in claim 2 wherein said first window forming and area gradient determining step comprises the step of 
s^mS^idual ones of the intensity gradient va.ues in said first window to produce the area gradient value. 
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4. The method in claim 3 wherein said thresholding step conprises the steps of- 

comparing the area gradient value. GS(ij), to a pre-defined gradient threshold value. GT. so as to produce 
a comparison signal .nd.cat.ve of whether a current one input pixel located at the current pixel position (|5 in tte 
input image lies in a vicinrty of an edge in said irput image; t*™*xt\w m me 

if the comparison signal indicates that said current 'one input pixel does not lie in the vicinity of the edoe 
thresholding^ response to sad comparison signal, said input pixel value at position (i j) in the input bnage against 

if the comparison signal indicales that said one current input pixel does lie within the vicinity of an edoe 
setting. ,n response to sari comparison signal, said corresponding binary outpul value to a first or.second state H 

!^Zety° ne 6XCeedS ° r fe ' eSS ^ a " aVCra9e ° f thC maximum and minimum ■*•> 

5. The method in claims 3 or 4 wherein said intensity gradient measuring step comprises the step of producing the 
TsoSfoSraS CUrr6n1 POSHi0n ^ PfOCeS5i " 9 ^ ,Wrd WindOW 01 input p * el values^SugS 

6. The method in claim 5 wherein the third window is a 3-by-3 window of input pixel values end the Sobel operator 
implements the following equations: operator 

GX(iJ)« Lfi+1j.1) + 2L(i4lj) + ^1j + 1) - L(i-1 -2L(i-1,i) - Mi-1 
GY(ij) e L0-1 + 2Lfcj+l) + LfH-1 j+1) . LO-lj-l) . 2L(lj-1) - Lfi+1 j-1); 

and 

G(ij)"=|GX(ij)|4|GY(ij)| 

where: L(i j) is an input pixel value, in luminance, for 
the pixel position (i j) in the input image. 

7. The method in claim A funtier comprising the steps of: 

producing, in response to said comparison signal and the pixel value <l_c) at the current pixel position (1 J) a 
modif.ed gray-scale output pixel value at position (i j) in a second output image? wherein. H the con^Ssional 
indicates that the one current input pixel does not lie in the vicinity of the edge in said input tm^gT^mcX 
gray-scale output pixel value is set equal to the pixel value L« or if the comparison signal^icates tnaVmeTnS 
one input pixel does he in the vanity of the edge, the modified gray-scale output pixel value is set equal to fp^ 
^'"edvalue greater than or less than the threshold value IT when the pixel value Ic is greater or lessen re^oet 
tively. the threshold value IT; and ^* ' res P ec 

thresholding the modified gray-scale output pixel value, against the threshold value IT. to yield a corresoondinn 
second binary output pixel value at a pixel position (i.j) within a secoreJ output image. corresponding 

. Apparatus for thresholding an input gray-scale image into a first outpul image, wherein said input image is formed 
of inpul ^xels each havinga mult.-b.. gray-scale pixel value associated therewith. arxJ wherein said first oltpUirn^Qe 
« formed of pixels each having a corresponding output pixel value associated therewith, characterized! 
apparatus utilizes the steps recited in any of claims 1-7. n mai 
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intensity gradients tor a matrix of pixel posrtions 370) 

then classHied as being an object pixel. i.e.. black, or a 
background pixel, i.e. white, based upon its area gradi- 
ent. GS(i.j). and associated l^, and Lmex measures. 
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